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FOREWORD 


Almost  40  percent  of  the  Army's  personnel  resources  are  civilians.  These 
400,000  employees  are  an  integral  part  of  the  Total  Army  team  and  contribute 
significantly  to  accompl i shi ng  the  Army  mission. 

This  research  was  part  of  the  Civilian  Personnel  and  Management  task  con¬ 
ducted  by  the  Leadership  and  Management  Technical  Area  (LMTA)  of  the  Manpower 
and  Personnel  Research  Laboratory  (MPRL).  The  effort  was  supported  by  a  Memo¬ 
randum  of  Agreement  entitled  "Support  for  Army  Civilian  Personnel  Research," 
dated  5  November  1986.  The  results  of  this  research  were  briefed  to  the  Chief, 
Directorate  of  Civilian  Planning  and  Evaluation  Office  (DAPE-CPP),  on  23  Novem¬ 
ber  1S87.  These  results  provided  input  for  the  planning  of  a  recently  initiated 
major  research  effort  that  the  Army  Research  Institute  is  conducting  for  the 
Directorate  of  Civilian  Personnel. 

Heretofore  the  possibility  of  improving  the  management  of  these  civilian 
employees  through  the  development  of  a  comprehensive  research  program  has  re¬ 
ceived  little  attention.  This  report  marks  the  second  major  activity  aimed  at 
designing  and  carrying  out  such  a  program. 

The  research  priorities  established  in  this  report  will  assist  policy 
makers  and  researchers  alike  in  making  informed  judgments  about  the  issues  in 
civilian  personnel  management  that  should  be  addressed  first. 


EDGAR  M.  JOHNSON 
Technical  Director 
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ESTABLISHING  PRIORITIES  FOR  CIVILIAN  PERSONNEL  MANAGEMENT  RESEARCH  IN  THE  ARMY 


EXECUTIVE  SUMMARY 


Requi rement: 

To  design  and  implement  a  procedure  for  assigning  priorities  to  previously 
identified  research  topics  aimed  at  improving  the  management  of  the  Army's 
ci vi 1 lan  personnel . 


Procedure: 

Based  on  the  results  of  an  earlier  effort  (Army  Strategic  Plan  for  Civi¬ 
lian  Personnel  Management  Research:  A  Roadmap  for  the  Future),  a  questionnaire 
that  contained  16  broad  areas  for  possible  research  was  designed.  It  was 
distributed  to  104  key  individuals  throughout  the  Army.  They  were  drawn  from 
all  major  commands  and  represented  military  and  civilian  personnel,  personnel- 
ists  and  managers,  those  with  staff  assignments  and  those  in  the  field,  and 
those  who  participated  in  the  Roadmap  study  as  well  as  those  who  did  not.  The 
survey  participants  were  asked  to  rate  each  of  the  areas  on  three  dimensions: 
(a)  the  value  of  improvement  in  the  area,  (b)  the  seriousness  of  the  conse¬ 
quences  of  no  improvement,  and  (c)  the  likelihood  that  additional  information 
would  be  used. 


Findings: 

Based  on  the  81  responses  received,  priorities  were  determined  for  each  of 
the  16  areas  on  four  scales:  Three  scales  used  the  rating  dimensions  in  the 
questionnaire,  and  the  fourth  was  an  overall  or  composite  scale  calculated  from 
the  other  three.  The  top  priority  topics  (based  on  the  composite  scores)  were 
related  to  retention,  recruitment,  and  the  identification  and  development  of 
supervisors  and  managers.  The  lowest  priority  topics  were  related  to  mobiliza¬ 
tion  issues,  manpower  forecasting,  and  organizational  effectiveness. 


Utilization  of  Findings: 

The  information  in  this  report  can  be  used  to  help  decision  makers  deter¬ 
mine  the  topics  to  investigate  first.  The  ultimate  value  of  this  effort, 
therefore,  cannot  be  gauged  until  these  determinations  have  been  made. 
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ESTABLISHING  PRIORITIES  FOR  CIVILIAN  PERSONNEL  MANAGEMENT  RESEARCH  IN  THE  ARMY 


INTRODUCTION 

In  1985  the  U.S.  Army's  Directorate  of  Civilian  Personnel  (DCP)  initiated  a 
long-term  project  aimed  at  improving  the  management  of  the  Army's  480,000 
civilian  employees.  Having  determined  that  this  improvement  could  best  be 
accomplished  through  a  comprehensive  civilian  personnel  management  research 
program,  DCP  negotiated  a  Memorandum  of  Agreement  with  the  U.S.  Army  Research 
Institute  for  the  Behavioral  and  Social  Sciences  (ARI)  to  collaborate  on  this 
multi-year  research  program. 

The  first  major  task  in  this  project  was  to  focus  the  research  and  to 
identify  specific  research  needs.  To  this  end,  a  study  was  conducted  for  DCP  by 
Caliber  Associates  in  which  key  individuals  throughout  the  Army  were  interviewed. 
This  study  produced  the  October  1986  document,  Army  Strategic  Plan  for  Civilian 
Personnel  Management  Research:  A  Roadmap  for  the  Future.  The  general  areas  of 
research  need  are  identified  in  Roadmap  as  follows: 

•  Recruitment 

•  Retention 

•  Personnel  development 

•  Organizational  productivity 

•  Motivational  productivity 

•  Military/civilian  relations 

•  Civilian  functions 

•  Future  civilian  work  force  needs 

Roadmap  also  provided  a  useful  framework  for  addressing  these  needs  through  a 
four-step  process:  (a)  developing  baseline  measures,  (b)  analyzing  the  relevant 
issues,  (c)  identifying  potential  strategies  for  improvement,  and  (d)  testing  and 
evaluating  the  most  promising  strategies. 

Because  DCP  wished  not  only  to  have  the  research  conducted  in  a  systematic 
manner  but  also  tc  focus  initially  on  the  most  important  research  topics,  a 
procedure  for  assigning  priorities  to  the  research  topics  reported  in  the 
Roadmap  had  to  be  designed  and  implemented.  The  process  used  to  assess  the 
relative  importance  of  these  research  topics,  as  perceived  by  key  individuals 
throughout  the  Army,  is  described  in  the  present  document.1 


METHOD 


Survey  Instrument 

Research  areas  to  be  prioritized.  The  major  objectives  and  enabling 
objectives  specified  in  the  Roadmap  for  the  Army's  civilian  personnel  program, 
together  with  the  specific  research  suggestions  also  presented  in  that  document, 
served  as  the  basis  for  the  items  included  in  the  Prioritization  Survey.  Table  1 
lists  the  resulting  16  items. 


*A  secondary  need  was  the  gathering  of  information  and  articulation  of  additional 
considerations  that  might  affect  the  decision  of  whether  (or  when)  to  initiate  a 
given  research  effort.  This  second  activity  is  reported  in  a  companion  document 
by  Clark  and  Saveli  (in  preparation). 


Table  1 

Research  Areas  Included  in  Prioritization  Survey 


Item 

code 


Item 

specification 


Q1  Attracting  high  quality  candidates  for  Army  jobs 

Q2  Selecting  candidates  who  have  potential  for  high  performance  from  the 
pool  of  qualified  applicants 

Q3  Making  sure  that  candidates  who  are  selected  actually  get  hired 
Q4  Retaining  productive  employees 

Q5  Separating  poorly  performing  employees 

Q6  Dealing  with  the  impact  of  mission  changes  on  the  work  force 
Q7  Assessing  employee  performance 

Q8  Enhancing  individual  productivity 

Q9  Identifying  good  candidates  for  supervisory  and  managerial  positions 

Q10  Developing  supervisory,  managerial,  and  leadership  skills 

Qll  Assessing  the  performance  of  supervisors  and  managers 

Q12  Increasing  the  effectiveness,  productivity,  and  image  of  civilian 
personnel  offices 

Q13  Building  effective  military/civilian  relations 

Q14  Developing  strategies  for  improving  organizational  effectiveness 

Q15  Determining  appropriate  functions  for  civilian  employees  in  peacetime  and 
during  mobilization 

Q16  Forecasting  long-term  requirements  for  the  Army  civilian  work  force 


2 


Prioritization  questions.  There  are  many  possible  perspectives  for  assessing 
the  importance  of  one  topic  relative  to  another.  The  questions  which  survey 
participants  were  asked  about  each  of  the  16  topics  on  the  Prioritization  Survey 
are  presented  in  Table  2  and  represent  three  of  these  perspectives. 2  The  first 
two  exemplify  essentially  a  benefit  and  cost  assessment--the  benefits  of  making 
improvements  and  the  costs  of  not  making  improvements.  The  third  question 
addresses  the  consideration  of  feasibility— the  likelihood  that  changes  which 
would  supposedly  result  in  improvement  would  actually  be  implemented. 3 


Table  2 

Primary  Questions  Asked  in  Prioritization  Survey 


•  How  valuable  would  it  be  to  the  Army  to  improve  things  in  this  area? 

•  How  serious  are  the  consequences  for  the  Army  of  not  improving  things  in  this 
area? 

•  If  additional  information  on  this  topic  were  obtained  from  research,  how 
confident  are  you  that  this  information  would  be  used  or  acted  upon? 


Data  analysis.  There  were  four  potential  Indicators  of  the  relative  priority 
of  each  of  the  16  research  areas— the  three  individual  measures  (questions)  plus 
a  composite  (the  simple  sum  of  the  three).  The  48  responses  of  an  individual  (16 
research  areas  with  three  questions  on  each  area)  were  first  standardized.4  The 
standardized  responses  were  then  summed  across  individuals  for  each  of  the  four 
measures.  Next,  each  of  the  four  resulting  scores  for  each  research  area  were 
rank-ordered  (from  one  to  sixteen)  across  the  research  areas,  based  on  their 
average  scores.5 


2See  the  section  in  Appendix  C  entitled  "Development  of  Survey  Instrument"  for 
details  on  the  review  and  validation  of  the  Prioritization  Survey.  Appendix  A 
contains  a  copy  of  the  instrument  itself. 

3There  are  many  reasons  why  an  individual  might  feel  that  such  changes  would  not 
be  implemented.  For  example,  the  changes  might  be  judged  too  costly  (in  terms  of 
dollars  or  efficiency),  or  there  might  simply  be  an  inertia  in  certain  Army 
practices  and  procedures  which  make  any  change  unlikely. 

4This  technique  helps  to  control  for  the  tendency  of  some  individuals  to  respond 
positively  to  most  questions  and  others  to  respond  negatively  to  most  questions. 

5See  the  section  of  Appendix  C  entitled  "Construction  and  Use  of  Scales"  for 
further  information  on  the  procedures  used. 


Because  this  investigation  was  intended  to  focus  on  key  individuals  and 
opinion  leaders  throughout  the  Army,  it  was  necessary  for  DCP  and  the  Special 
Advisory  Group  to  identify  the  appropriate  survey  population  for  the 
prioritization  activity.®  Drawn  from  all  major  commands  in  the  Army,  these 
identified  individuals  represent  personnel ists  and  managers  alike,  uniformed  and 
civilian  personnel,  those  with  staff  assignments  and  those  in  the  field,  and 
those  who  participated  in  Roadmap  and  those  who  did  not.  Of  the  104  individuals 
who  comprised  the  population,  81  returned  questionnaires,  a  response  rate  of 
about  78  percent. ^  Table  3  summarizes  the  characteristics  of  the  final  survey 
population  and  the  identifiable  respondents.8 


Table  3 


Characteristics  of  Survey  Participants 


Number  of 
sent  out 

surveys: 

returned 

Percent 

returned 

Total 

104 

81 

787. 

Civi 1 ian 

65 

47 

72 

Military 

39 

28 

72 

Field* 

61 

46 

75 

Staff* 

41 

27 

66 

Manager 

73 

54 

74 

Personnel ist 

31 

21 

68 

Roadmap  Nonparticipant 

60 

48 

80 

Roadmap  Participant 

44 

27 

61 

Not  Identified 

-- 

6 

-- 

*Two  individuals  are  employed  outside  of  the  Army. 


^Members  of  the  Special  Advisory  Group  are  the  same  individuals  who  served  as 
members  of  the  Study  Advisory  Group  during  the  Roadmap  study  and  are  identified 
in  Appendix  B. 

7A  list  of  the  identifiable  respondents  (six  individuals  returned  questionnaires 
without  indicating  their  names)  appears  in  Appendix  B. 

8The  section  in  Appendix  C  entitled  "Survey  Respondents"  has  more  details  about 
who  constituted  the  final  survey  population. 
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Survey  Procedure 

Survey  materials  were  distributed  to  targeted  participants  either  by  mail  or 
by  courier.  A  cover  letter,  signed  by  Raymond  J.  Sumser,  Director  of  Civilian 
Personnel,  requested  their  cooperation  in  completing  the  questionnaire  and 
returning  it  within  a  month.  Respondents  were  asked  to  indicate  their 
willingness  to  participate  in  a  telephone  follow-up  interview  by  including  their 
telephone  numbers  along  with  the  identification  material  requested.  After  the 
return  date  had  passed,  DCP  and  ARI  called  nonrespondents  to  ask  them  to  send  in 
their  questionnaires.9  A  series  of  follow-up  interviews  were  conducted  by 
telephone  with  a  representative  sample  of  respondents  to  confirm  that  they 
understood  the  questionnaire  items  as  intended  and  to  provide  an  opportunity  for 
making  additional  comments  about  the  survey  in  particular  and  about  civilian 
personnel  management  research  in  general. 


RESULTS 


Follow-Up  Interviews 

Sixteen  telephone  follow-up  interviews  were  completed.10  The  contacted 
individuals  represented  all  groups  of  interest--those  based  in  the  United  States 
and  overseas,  personnel ists  and  managers,  uniformed  and  civilian,  staff  and 
field,  and  Roadmap  participants  and  nonparticipants. 

Ranking  of  the  16  Topics 

Table  4  summarizes  the  results  of  the  prioritization  process,  showing  the 
rank  order  (from  1  to  16)  of  each  topic  on  each  of  the  four  scales.  Because  the 
composite  score  represents  an  overall  assessment  of  each  item,  the  rank  of  each 
item  on  the  composite  scale  was  judged  to  be  of  primary  interest. 

As  a  matter  of  convenience,  the  16  topics  were  grouped  into  three  distinct 
subsets  (i.e.,  with  statistically  reliable  differences)  on  the  basis  of  overall 
composite  scores.11  Table  5  presents  the  full  text  of  the  grouped  items  in 
priority  order. 


9See  the  section  in  Appendix  C  entitled  "Survey  Schedule"  for  further 
information. 

10See  the  sections  in  Appendix  C  entitled  "Development  of  Survey  Instrument: 
Validation"  and  "Follow-Up  Interviews"  for  more  details  about  these  interviews. 
Appendix  C-l  contains  the  text  of  the  interview  itself. 

^The  section  in  Appendix  C  entitled  "Analyses  of  Combined  Groups:  Grouping  of 
Items"  contains  details  about  the  statistical  technique  used  to  group  the  items. 
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Table 

4 

\ 

\ 

\ 

|  Detailed  Summary  of  Prioritization 

Results 

\ 

l 

t 

t 

* 

s 

Rank 

: 

I  Item 

£  code 

•* 

Item 

specification 

Need  for 
improvement 

Consequences 
of  no 

improvement 

Likelihood 
of  action 

■ 

Unweighted  > 

composite  ! 

j 

’ 

i  Qi 

Attracting  high  quality 
candidates  for  Army  jobs 

1 

1 

7 

2  ~  1 

Q2 

Selecting  candidates  who 
have  potential  for  high 
performance  from  the  pool 
of  qualified  applicants 

8 

9 

6 

» 

I  Q3 

Q 

t 

\ 

Making  sure  that 
candidates  who  are 
selected  actually  get 
hi  red 

16 

16 

4 

14  | 

Q4 

Retaining  productive 
employees 

2 

2 

1 

1  "i 

!  Q5 

Separating  poorly 
performing  employees 

4 

4 

16 

6  ! 

1  Q6 

Dealing  with  the  impact 
of  mission  changes  on  the 
work  force 

12 

12 

11 

12 

I  Q7 

Assessing  employee 
performance 

11 

13 

5 

11  : 

S  Q8 

1 

Enhancing  individual 
productivity 

6 

6 

8 

5 

* 

!  Q9 

Identifying  good 
candidates  for  supervisory 
and  managerial  positions 

5 

3 

2 

3  { 

■fl 

l  Q1° 

Developing  supervisory, 
managerial,  and  leadership 
skills 

3 

5 

3 

4  ij 

1 

oil 

Assessing  the  performance 
of  supervisors  and  managers 

7 

7 

10 

8  t 

RnwuNwuuAonb 

6 

1 

•n 

j 

V1».7tVI 


Table  4  (continued) 


Rank 

Item 

code 

Item 

specification 

Need  for 
improvement 

Consequences 
of  no 

improvement 

Likelihood 
of  action 

Unweighted 

composite 

012 

Increasing  the  effectiveness, 
productivity,  and  image  of 
civilian  personnel  offices 

9 

10 

12 

9 

013 

Building  effective  military/ 
civilian  relations 

10 

8 

13 

10 

Q14 

Developing  strategies  for 
improving  organizational 
effectiveness 

15 

15 

15 

16 

Q15 

Determining  appropriate 
functions  for  civilian 
employees  in  peacetime 
and  during  mobilization 

14 

11 

9 

13 

016 

Forecasting  long-term 
requirements  for  the  Army 
civilian  work  force 

13 

14 

14 

15 

Note.  Areas  with  highest  priority  ratings  have  the  smallest  numerical  ranks. 


Table  5 


Overall  Priorities  in  Army  Civilian  Personnel  Management  Research 


TOP  PRIORITY  TOPICS 

Q4  Retaining  productive  employees 

Q1  Attracting  high  quality  candidates  for  Army  jobs 

Q9  Identifying  good  candidates  for  supervisory  and  managerial  positions 
Q10  Developing  supervisory,  managerial,  and  leadership  skills 

MIDDLE  PRIORITY  TOPICS 

Q8  Enhancing  individual  productivity 

Q5  Separating  poorly  performing  employees 

Q2  Selecting  candidates  who  have  potential  for  high  performance  from  the  pool 

of  qualified  applicants 

Qll  Assessing  the  performance  of  supervisors  and  managers 

012  Increasing  the  effectiveness,  productivity,  and  image  of  civilian 
personnel  offices 

Q13  Building  effective  military/civilian  relations 

Q7  Assessing  employee  performance 

LOWEST  PRIORITY  TOPICS 

Q6  Dealing  with  the  impact  of  mission  changes  on  the  work  force 

015  Determining  appropriate  functions  for  civilian  employees  in  peacetime  and 
during  mobilization 

Q3  Making  sure  that  candidates  who  are  selected  actually  get  hired 
Q16  Forecasting  long-term  requirements  for  the  Army  civilian  work  force 
Q14  Developing  strategies  for  improving  organizational  effectiveness 

Note.  Priorities  are  based  on  unweighted  composite  scores. 
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In  Section  2  of  the  Prioritization  Survey,  participants  were  asked  to 
identify  the  three  areas  in  which  a  systematic  research  effort  would  make  the 
greatest  contribution  to  the  Army  and  the  one  area  in  which  such  an  effort  would 
make  the  least  contribution.  Figure  1  shows  the  frequency  with  which  certain 
items  were  selected  as  the  most  promising  areas,  and  Figure  2  presents  the 
frequency  with  which  some  items  were  chosen  as  the  least  beneficial  areas. 


All  Others 
(72) 


09  / 
(16)/  Q5 
/  (17) 


Notes. 

This  figure  includes  all  three  of  those  areas  identified  by  respondents  as 
benefitting  most  from  systematic  research  efforts. 

Figures  in  parentheses  indicate  the  number  of  times  a  particular  area  was  listed  in 
the  top  three. 

See  Table  1  for  specification  of  research  areas. 

Figure  1.  Areas  for  which  respondents  felt  systematic  research  efforts  would 
make  the  greatest  contribution  to  the  Army. 


wm 


Notes. 


See  Table  1  for  specification  of  research  areas. 

Figures  in  parentheses  indicate  the  number  of  times  a  particular  area  was  listed. 


Figure  2.  Areas  for  which  respondents  felt  systematic  research  efforts  would 
make  the  least  contribution  to  the  Army. 


Testing  for  Between-Group  Differences 

Given  the  diverse  nature  of  the  survey  respondents,  one  of  the  first  issues 
to  be  addressed  in  the  data  analysis  was  whether  or  not  the  various  groups  (i.e., 
military  versus  civilian,  staff  versus  field,  personnelist  versus  manager,  and 
Roadmap  participant  versus  nonparticipant)  differed  in  their  responses.  If  one 
group  differed  systematically  from  another  in  its  perceptions,  then  group 
membership  would  become  a  factor  in  assessing  priorities.  Although  the 
calculated  scores  for  these  groups  did  in  fact  differ  on  almost  every  item  and 
every  scale,  these  differences  were  too  small  to  be  statistically  reliable.12 


12See  the  section  in  Appendix  C  entitled  "Investigation  of  Group  Differences 
for  details  of  the  statistical  comparisons. 


DISCUSSION 


The  telephone  follow-up  interviews  did  not  identify  any  glaring 
inconsistencies  in  the  intent  of  the  wording  of  the  questionnaire  and  the 
respondents'  understanding  of  it.  The  third  item,  "Making  sure  that  candidates 
who  are  selected  actually  get  hired,"  seemed  to  be  a  possible  source  of  confusion 
for  some  respondents,  however.13  This  finding  is  not  prominent  enough  to  warrant 
excluding  this  item  from  consideration,  but  results  associated  with  the  third 
item  should  be  interpreted  with  caution.  Since  there  was  an  indication  that  at 
least  some  respondents  did  not  differentiate  this  issue  from  selection  (Q2)  or 
recruitment  (Ql),  one  might  argue  that  Q3  would  be  more  appropriately  placed  in 
the  top  or  middle  priority  groups. 


It  is  interesting  to  note  the  tendency  of  survey  participants  as  a  whole  to 
respond  similarly  for  each  item  on  the  two  benefit/cost  dimensions  (i.e., 
need-for-improvement  and  consequences-of-no- improvement)  and  strikingly  different 
on  the  third  dimension  (i.e.,  1 ikel ihood-of-action) ,14  This  is  particularly  true 
for  items  Ql  (recruitment),  Q3  (hiring  selected  candidate),  Q5  (separation),  and 
Q7  (performance  assessment).  There  are  many  possible  explanations  for  these 
differences.  For  example,  in  the  cases  of  Q3  and  Q7,  respondents  may  judge  the 
underlying  problems  to  be  relatively  minor,  while  they  perceive  that  the  Army 
policies  and  procedures  that  relate  to  them  can  be  changed  without  too  much 
difficulty.1^  In  the  cases  of  Ql  and  Q5,  perhaps  the  underlying  problem  is  of 
great  importance  to  the  Army,  but  many  of  the  relevant  constraints  exist  outside 
the  Army  (e.g.,  in  the  Federal  Civil  Service  Personnel  System)  and  are, 
therefore,  difficult  to  change. 

The  relative  rank  order  of  the  items  most  often  mentioned  as  making  the 
greatest  contribution  to  the  Army  (see  Figure  1)  does  not  correspond  exactly  with 
those  in  Table  5,  but  the  pattern  of  results  is  not  inconsistent.  Likewise,  the 
four  areas  picked  by  survey  participants  as  offering  the  least  contribution  to 
the  Army  (see  Figure  2)  are  among  the  bottom  items  in  Table  5.  This  evidence 
seems  to  support  the  validity  of  the  computed  composite  scores  and  resultant 
rankings. 


13This  view  is  supported  somewhat  by  other  evidence  as  well.  See  the  section  of 
Appendix  C  entitled  "Follow-Up  Interviews:  Interview  Results”  for  further 
details. 

14Se:  able  4.  Figures  C-6,  C-7,  and  C-8  in  Appendix  C  illustrate  these 
patt^  graphically. 

15The  reader  should  remember  too  that  there  is  some  doubt  about  the  consistency 
of  the  interpretation  given  to  Q3. 


CONCLUSION 


To  assess  Army-wide  priorities  for  research  to  improve  the  management  of  Army 
civilian  personnel  is  an  important  first  step  in  deciding  which  research  topics 
are  ultimately  the  most  important.  The  prioritization  results  presented  here  may 
be  legitimate  (perhaps  even  primary)  considerations  affecting  decisions  about 
whether  (and  when)  to  initiate  one  research  activity  rather  than  another,  but 
they  are  by  no  means  the  only  factor  that  must  be  taken  into  account.  The 
companion  document  to  this  report  by  Clark  and  Saveli  (in  preparation)  suggests 
some  of  these  other  factors. 
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TRANSMITTAL  SHEET 


Please  provide  the  following  information  so  that  we  can  check  your  name  off  the 
list  of  individuals  surveyed.  Having  this  information  will  enable  us  to  make 
sure  that  the  responses  received  represent  a  sufficiently  broad  range  of  Army 
opinion.  (Please  print). 


Name: 

Position: 

Installation: 


We  would  also  like  to  telephone  a  few  respondents  to  provide  an  opportunity  for 
them  to  voice  their  opinion  on  these  issues  in  a  more  unstructured  way.  If  you 
are  willing  to  answer  some  additional  questions  by  phone,  please  write  in  your 
telephone  number  below  (we  may  not  be  able  to  call  everyone  who  volunteers). 


Telephone  Number: 


When  you  have  completed  the  questionnaire,  please  return  this  sheet  and  the 
other  materials  to: 

Labor  and  Policy  Studies  Program 
Oak  Ridge  Associated  Universities 
P.0.  Box  117 

Oak  Ridge,  Tennessee  37831-0117 
ATTN:  Clark 


Thank  you  for  your  cooperation! 
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Acton,  Ms.  Marie** 

Adams,  CW2  David  C. 

Arndt,  BG  Terrence  L. 

Bagnal ,  LTG  Charles  W. 
Barnett,  Lowell  H. 

Baughn,  Ms.  Brenda  K. 
Baxter,  Carl 

Blount,  David*** 

Bonessa,  Barbara  L. 

Borneman,  COL  Frederick 

Bostak,  Ronald  J. 

Bradley,  Franklin  M. 
Brannen,  R.  Warren 


LIST  OF  SURVEY  RESPONDENTS* 


Deputy  for  Management  and  Analysis 
HQ,  U.S.  Army  Materiel  Command 
Alexandria,  VA 

Personnel  Officer 

379th  Personnel  Service  Company 

Heidelberg,  W.  Germany 

Deputy  Chief  of  Staff  for  Resource  Management 
HQ,  U.S.  Army  Material  Command 
Alexandria,  VA 

Commanding  General,  U.S.  Army  Western  Command 
Fort  Shafter,  HI 

Director,  Product  Assurance  and  Test  Division 
U.S.  Army  Tank-Automotive  Command 
Warren,  MI 

Supervisory  Management  Analyst 
Fort  Sill,  OK 

Management  Analyst,  Plans  &  Analysis  Division 

Office  of  the  Inspector  General 

HQDA 

Pentagon 

Supervisory  Management  Analyst,  Manpower 
Programs  and  Budget  Branch 
Office  of  the  Deputy  Chief  of  Staff  for  Personnel 
HQDA 
Pentagon 

Chief,  Proponency  Office 

Office  of  the  Assistant  Secretary  of  the  Army 
(Financial  Management) 

HQDA 

Pentagon 

Deputy  Community  Commander,  26th  Support  Group 
HQ,  U.S.  Army  Europe  &  7th  Army 
Heidelberg,  W.  Germany 

Director,  Nuclear  Survivability  Program  Office 
Harry  Diamond  Laboratories 
Adelphi ,  MD 

Civilian  Personnel  Officer 
Aberdeen  Proving  Ground,  MD 

Chief,  Operations  Branch 
Supply  and  Services  Division,  Directorate  of 
Logistics 
Fort  Stewart,  GA 


Brown,  COL  Henry  T.,  Jr 


Director  of  Engineering  and  Housing 
Fort  Carson,  CO 


Bunker,  BG  Robert  M.** 


Busbee,  COL  Walter 


Bushong,  COL  James  T. 


Caldwell ,  LTC  William 


Cameron,  Dr.  Louis  M. 


Carlson,  Joseph  S. 


Cipolla,  Frank  P. 


Cribbins,  Joseph  T. 


Croall ,  Stephen  T. 


Doctor,  LTG  Henry,  Jr. 


Dubicki ,  Dr.  Henry  J. 


Director  of  Management 

Office  of  the  Chief  of  Staff  of  the  Army 

HQDA 

Pentagon 

Commander,  McAlester  Army  Ammunition  Plant 
McAlester,  OK 

Staff  Director,  Civilian  Personnel  Modernization 
Project 
HQDA 
Pentagon 

Chief,  Organization,  Research,  &  Systems  Analysis 
Office 

HQ,  U.S.  Army  Europe  &  7th  Army 
Heidelberg,  W.  Germany 

Director  of  Research  and  Technology 
Office  of  the  Assistant  Secretary 

(Research,  Development,  &  Acquisition) 

HQDA 

Pentagon 

Field  Representative,  U.S.  Army  Civilian 
Personnel  Center 
San  Francisco  Field  Office 
San  Francisco,  CA 

Director,  Personnel  Management 
Force  Management  and  Personnel 
Office  of  the  Secretary  of  Defense 
Pentagon 

Special  Assistant  to  the  Deputy  Chief  of  Staff 
for  Logistics 
HQDA 
Pentagon 

Director,  Manpower  Requirements 
U.S.  Army  Manpower  Requirements  and 
Documentation  Agency 
Fort  Belvoir,  VA 

The  Inspector  General 

HQDA 

Pentagon 

Office  of  the  Assistant  Secretary 

(Research,  Development,  &  Acquisition) 

Deputy  for  Procurement  Policy  (Acquisition) 

HQDA 

Pentagon 
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Eckelbarger,  MG  D.  E 


Fowler,  Dr.  Calvin  M. 

Fraim,  William  S. 

Grimmett,  Archie  D.*** 

Hatch,  MG  H.  J. 

Heiberg,  LTG  E.  R.,  Ill 

Hines,  BG  Charles  A. 

Houston,  James  R. 

Husson,  Richard  D. 

Jones,  C.  Casy 

Joyce,  MG  Robert  M. 

Kiper,  Jack  E. 


Director  of  Human  Resources  Development 

Office  of  the  Deputy  Chief  of  Staff  for  Personnel 

HQDA 

Pentagon 

Chief,  Manpower  Policy  and  Standards  Office 
Manpower,  Budget,  and  Force  Integration  Directorate 
HQDA 
Pentagon 

Civilian  Personnel  Director 
U.S.  Army  Forces  Command 
Fort  McPherson,  GA 

Acting  Deputy  Chief  of  Staff  for  Personnel 
HQ,  U.S.  Army  Materiel  Command 
Alexandria,  VA 

Director,  Civil  Works 

HQ,  U.S.  Army  Corps  of  Engineers 

Washington,  D.C. 

Chief  of  Engineers 

HQ,  U.S.  Army  Corps  of  Engineers 

Washington,  D.C. 

Director,  Office  of  Personnel  Management 
U.S.  Army  Military  Personnel  Center 
Alexandria,  VA 

Chief,  Coastal  Engineering  Research  Center 
U.S.  Army  Engineers  Waterway  Experiment  Station 
Vicksburg,  MS 

Deputy  Director  of  Maintenance 
HQ,  U.S.  Army  Armament,  Munitions, 
and  Chemical  Command 
Rock  Island,  IL 

Assistant  Deputy  Chief  of  Staff  for  Engineering 
HQ,  U.S.  Army  Europe  &  7th  Army 
Heidelberg,  W.  Germany 

Commanding  General,  U.S.  Army  Community  and 
Family  Support  Center 
Alexandria,  VA 

Chief,  Construction-Operations  Division 
Ohio  River  Engineer  Division 
U.S.  Army  Corps  of  Engineers 
Cincinnati,  OH 


Kirkwood,  Gregory  H 


Director  of  Logistics 
Fort  Sill,  OK 


Klugh,  MG  James  R 


Deputy  Chief  of  Staff  for  Personnel 
HQ,  U.S.  Army  Materiel  Command 
Alexandria,  VA 


Langston,  Ms.  Joann*** 


Lorenz,  Ms.  Susan  K. 


Loschialpo,  R. 


McCarthy,  COL  William  J. 


McClain,  Frank  W. 


McGinn,  Ms.  Gail  H. 


Director,  Study  Program  Management  Office 
Office  of  the  Chief  of  Staff  of  the  Army 
HQDA 
Pentagon 

Deputy  Chief  of  Staff  for  Information  Management 
U.S.  Army  Information  Systems  Command 
Fort  Huachuca,  AZ 

Personnel  Director 

HQ,  U.S.  Army  Corps  of  Engineers 

Washington,  D.C. 

Executive  Officer,  Deputy  Chief  of  Staff  for 
Personnel 
HQDA 
Pentagon 

Civilian  Executive  Assistant 
Red  River  Army  Depot 
Texarkana,  TX 

Director,  Program  Analysis  and  Evaluation  Office 
U.S.  Army  Community  and  Family  Support  Center 
Alexandria,  VA 


Mergner,  COL  George  F. 


Michael,  Raymond  V, 


Morris,  Kenneth  C. 


Newman,  Peter 


Otis,  GEN  Glenn  K. 

Purdum,  Gary 


Assistant  Chief  of  Staff  for  Resource  Management 

HQ,  Eighth  U.S.  Army 

Korea 

ADCS  for  Personnel,  Administration,  &  Logistics 
(Civi 1 ian  Personnel ) 

HQ,  U.S.  Army  Training  and  Doctrine  Command 
Fort  Monroe,  VA 

Deputy  Director  of  Civilian  Personnel 
HQ,  U.S.  Army  Materiel  Command 
Alexandria,  VA 

Personnel  Management  Specialist 
U.S.  Army  Western  Command 
Fort  Shafter,  HI 

Commander-in-Chief 
U.S.  Army  in  Europe 
Heidelberg,  W.  Germany 

Deputy  Director,  Manpower,  Budget,  &  Force 
Integration 

Office  of  the  Deputy  Chief  of  Staff  for  Personnel 

HQDA 

Pentagon 
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Purvis,  Gerald  T. 

Chief,  National  Resources  Branch 

Construction  and  Operations  Division  09 

South  Atlantic  Division,  U.S.  Army  Corps  of  Qjj 

Engineers  ^ 

Atlanta,  GA  w- 

Ragan,  David  W. 

Deputy  Chief,  Shops  Division  Bx 

Anniston  Army  Depot 

Anniston,  AL  ^ 

Reno,  BG  William  H. 

Deputy  Chief  of  Staff  for  Resource  Management 

HQ,  U.S.  Army  Training  and  Doctrine  Command  $ 

Fort  Monroe,  VA  ue 

Ressler,  Alton  C. 

Assistant  Deputy  Chief  of  Staff  for  Personnel  - 

HQ,  U.S.  Army  Intelligence  and  Security  Command  § 

Arlington,  VA 

Richards,  D.  Scott 

Personnel  Officer  K 

Fort  Stewart,  GA  W 

Richardson,  Ms.  Lois  L. 

Chief,  Claims  Collection  Division  i 

U.S.  Army  Finance  &  Accounting  Center 

Fort  Ben  Harrison,  IN  jftul 

Rodgers,  LTG  Thurman  D. 

Assistant  Chief  of  Staff  for  Information  Management  Kg* 
HQDA  Mj | 
Pentagon  ij 

Rosenblum,  Arthur  P. 

Special  Assistant,  Information  Systems  ESI 

Office  of  the  Assistant  Secretary  of  the  Army  jftji 

(Financial  Management)  jv* 

HQDA 

Scott,  COL  Eugene  F. 

Pentagon  jfj 

Garrison  Commander  M 

Fort  Stewart,  GA  Nj 

m 

Shackelford,  LTC  John  S. 

Director  of  Contracting  yCl 

Fort  Ord,  CA 

Shepard,  Earl  A. 

Director  of  Resource  Management 

U.S.  Army  White  Sands  Missile  Range  W 

White  Sands,  NM  nS 

M 

Shields,  Dr.  Joyce  L. 

Vice  President,  Hay  Systems,  Inc.  ft 

Stein,  Peter 

Washington,  D.C.  35 

Deputy  Administrative  Assistant  NV 
Office  of  the  Secretary  of  the  Army  Cx 
HQDA  JOB 
Pentagon  ij 

Suess,  LTC  Robert  K. 

Executive  Officer  5 
Yuma  Proving  Ground  3J 
Yuma ,  AZ  jS 

B"5 

Chief,  National  Guard  Bureau 

HQDA 

Pentagon 


4  ^  *!*.'*«  V*  *t*?rt**%i 


Temple,  LTG  Herbert  R.,  Jr. 


Thomas,  Robert  K. 


Vollrath,  COL  Frederick  E. 


Walnwright,  Ms.  Toni  B. 


Ward,  MG  William  F.,  Jr. 


West,  Dr.  Harry  M.  Ill’ 


Wharton,  LTC  William  D.,  Jr. 


Wilkerson,  William  M. 


Yasi ,  Charles  A. 


Yurkoski ,  Anna  E. 


Deputy  Assistant  Chief  of  Staff  for  Resource  Mgmt. 

HQ,  Eighth  U.S.  Army 

Korea 

Deputy  Commander,  1st  Personnel  Command 
U.S.  Army  Europe  &  7th  Army 
Heidelberg,  W.  Germany 

Supervisory  Personnel  Management  Specialist 

Directorate  of  Civilian  Personnel 

HQDA 

Fort  Monroe,  VA 

Chief,  Army  Reserve 

HQDA 

Pentagon 

Deputy  Comptroller  of  the  Army 

HQDA 

Pentagon 

PD IP  POC 

Personnel  Readiness  and  Mobilization  Office 

HQDA 

Pentagon 

Assistant  Deputy  Chief  of  Staff  for  Resource  Mgmt. 
HQ,  U.S.  Army  Forces  Command 
Fort  McPherson,  GA 

Deputy  Commander,  Contracting  Command 
HQ,  U.S.  Army  Europe  &  7th  Army 
Heidelberg,  W.  Germany 

Chief,  Employment  and  Classification  Office 
Office  of  the  Deputy  Chief  of  Staff  for  Personnel 
HQDA 
Pentagon 


*  Does  not  include  6  respondents  who  failed  to  identify  themselves. 

**  Along  with  Dr.  Kent  Eaton,  Director,  Manpower  and  Personnel  Research 
Laboratory,  U.S.  Army  Research  Institute,  and  Andrew  F.  Foreman,  Chief, 
Civilian  Personnel  Division,  HQ,  U.S.  Army  Europe  and  Seventh  Army,  served 
as  member  of  the  project's  Special  Advisory  Group,  chaired  by  Raymond  J. 
Sumser,  Director  of  Civilian  Personnel. 

"*  Along  with  Dr.  Joel  M.  Saveli,  U.S.  Army  Research  Institute,  and  Arthur 
Walker,  Deputy  Director  of  the  Army  Budget,  Office  of  the  Comptroller  of  the 
Army,  served  as  alternate  member  of  the  project’s  Special  Advisory  Group. 
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APPENDIX  C 


TECHNICAL  DETAILS  OF  PRIORITIZATION  PROCESS 


Development  of  Survey  Instrument 


Content  review.  To  insure  that  the  items  (and  the  dimensions  on  which  each 
item  was  to  be  evaluated)  in  the  Prioritization  Survey  vere  presented  in  terms 
meaningful  to  the  wide  variety  of  Army  personnel  in  the  survey  population,  the 
proposed  items  and  rating  dimensions  were  reviewed  by  sibject  matter  experts 
(SMEs)  at  the  Army  Research  Institute  (ARI)  and  at  the  Directorate  of  Civilian 
Personnel  (DCP),  and  by  members  of  the  Special  Advisory  Group  (SAG)  for  the 
project.1®  Another  objective  for  this  review  was  to  insure  that  the  items 
covered  all  of  the  topics  presented  in  the  Roadmap. 

Validation.  Although  time  constraints  did  not  permit  a  pilot  testing  of  the 
questionnaire,  follow-up  telephone  interviews  were  conducted  with  a  sample  of  16 
respondents  to  determine  whether  or  not  the  respondents  in  general  interpreted 
the  items  and  rating  dimensions  as  intended.  Specifically,  the  respondents  were 
asked  whether  or  not  they  had  any  difficulty  understanding  the  items  or  rating 
dimensions.  No  interviewee  expressed  any  such  difficulty.  In  addition,  the 
individuals  contacted  were  asked  to  comment  in  more  depth  on  several  items 
specified  by  the  interviewer.  The  purpose  of  this  inquiry  was  to  determine 
whether  or  not  the  more  specific  issues  which  each  of  the  broad  areas  was 
intended  to  encompass  were  consistent  with  the  understanding  of  the  respondent. 

Although  no  serious  inconsistencies  were  revealed,  there  was  some  evidence 
that  at  least  some  respondents  were  confused  by  the  wording  of  the  third  item, 
"Making  sure  that  candidates  who  are  selected  actually  get  hired."17 


Survey  Schedule 


The  survey  materials  were  distributed  by  DCP  on  12  June  1987,  with  a  request 
that  they  be  returned  by  14  July  1987.  Sixty-seven  of  the  102  questionnaires 
sent  out  were  returned  by  that  date.  Telephone  calls  reminding  nonrespondents 
that  the  survey  materials  were  past  due  were  made  by  DCP  and  ARI  between  15  July 
and  21  July,  resulting  in  14  additional  questionnaires  being  returned  before  the 
data  analysis  began  on  24  July.  One  additional  questionnaire  was  received  on  29 
July,  but  it  was  not  included  in  the  analysis. 


^The  latter  group  consisted  of  the  same  individuals  who  comprised  the  Study 
Advisory  Group  for  the  Roadmap  study. 

17See  the  section  below  entitled  "Follow-Up  Interviews:  Interview  Results" 
for  empirical  evidence  that  seems  to  support  this  contention. 
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Survey  Respondents 

DCP  and  the  SAG  initially  identified  102  individuals  for  the  survey 
population.  Three  responses  were  received  from  individuals  who  were  judged  (by 
DCP)  to  be  acceptable  substitutes  for  specified  individuals  in  the  original 
population.  In  addition,  two  others  who  were  not  included  on  the  original  list 
sent  in  questionnaires  but  were  judged  (by  DCP)  to  be  suitable  members  of  the 
target  population,  although  it  was  not  apparent  for  whom  they  were  responding. 
This  brought  the  new  survey  population  total  to  104. 


Follow-Up  Interviews 

Selection  of  interview  sample.  Of  the  81  respondents,  67  indicated  a 
willingness  to  participate  in  follow-up  interviews.  Three  factors  were  used  to 
select  individuals  for  these  interviews:  (a)  whether  a  respondent  wrote  a 
comment  on  his/her  questionnaire  that  either  was  unclear  or  was  particularly 
interesting;  (b)  whether  responses  in  Section  1  of  the  questionnaire  seemed  to 
be  inconsistent  with  those  in  Section  2;  and  (c)  to  insure  that  all  relevant 
groups  (i.e.,  military  and  civilian,  managers  and  personnel ists,  staff  and 
field,  Roadmap  participants  and  nonparticipants,  and  installations  in  the 
continental  United  States  and  overseas)  were  represented  in  the  sample.  The 
first  two  criteria  were  judged  individually  and  resulted  in  10  individuals  being 
identified  for  the  interviews.  The  characteristics  of  these  10  people  were 
noted,  and  additional  questionnaires  were  randomly  drawn  until  all  groups  were 
represented  by  at  least  two  people.  This  second  step  resulted  in  the  addition 
of  12  individuals,  bringing  the  total  sample  selected  for  the  follow-up 
interview  to  22. 

Interview  process.  During  the  course  of  the  three  weeks  allotted  for  the 
interviews  (between  24  July  and  14  August),  attempts  were  made  to  contact  all  22 
individuals.  Sixteen  interviews  were  eventually  completed,  lasting  an  average 
of  41  minutes  each.  The  text  of  that  interview  is  contained  in  Appendix  C-l. 

The  interviewer  took  detailed  notes  during  the  course  of  the  conversation,  and 
these  notes  were  evaluated  by  the  researchers. 

Interview  results.  Most  of  the  persons  interviewed  had  little,  if  any, 
familiarity  with  the  Roadmap  final  report.  Their  own  perceptions  were  that  this 
lack  of  familiarity  did  not  cause  any  difficulty  in  understanding  the  issues  in 
the  Prioritization  Survey.  An  examination  of  the  remarks  made  in  response  to 
the  open-ended  questions  about  specific  research  areas  seemed  to  support  these 
perceptions.  For  the  most  part,  the  interviewees  discussed  specific  issues  that 
were  consistent  with  those  addressed  in  the  research  questions  in  Appendix  A  of 
Clark  and  Saveli  (in  preparation). 


A  notable  exception  to  this  consistency  was  the  third  item  on  the 
questionnaire,  "Making  sure  that  candidates  who  are  selected  actually  get 
hired.1'  Three  of  the  five  persons  who  were  asked  to  expand  upon  that  issue  made 
comments  which  indicated  a  lack  of  understanding  of  the  item's  intent.  This 
view  is  supported  by  empirical  evidence  as  well--23.8  percent  of  the 
nonstandard  responses  were  accounted  for  by  item  Q3: 


•  15.5  percent  (11)  of  the  nonresponses  (left  blank) 

•  46.7  percent  (21)  of  the  "?"  responses 

•  15.4  percent  (8)  of  the  "NN"  responses 

The  next  closest  item  was  Q5,  which  accounted  for  /'.7  percent  of  the  nonstandard 
responses. 

Construction  and  Use  of  Scales 

Before  manipulating  the  questionnaire  data,  the  responses  of  each  individual 
were  standardized  (i.e.,  converted  to  z-scores)  to  eliminate  the  possible 
response  set  of  that  individual  as  a  factor  in  explaining  results.  All 
nonstandard  responses  were  excluded  in  this  standardization  process.  Each  of 
the  three  rating  dimensions  included  in  the  questionnaire  (i.e., 
need-for-improvement,  consequences-of-no-improvement,  and  1 ikel ihood-of-action) 
was  used  as  an  individual  assessment  of  each  of  the  16  areas.  In  addition,  a 
fourth  scale,  a  composite,  was  calculated  for  each  item  by  summing  the 
standardized  responses  to  the  other  three  scales.  This  composite  was  used  in 
two  different  ways: 

1.  For  statistical  comparisons  of  subsets  of  respondents,  it  was  necessary 
to  use  only  those  observations  that  had  computationally  valid  responses  (i.e., 
"1",  "2",  "3",  or  "4")  on  all  three  original  scales.  These  are  termed 
"weighted"  composite  scores,  since  each  component  scale  is  based  on  the  same 
number  of  observations. 


2.  For  gross  comparisons  across  items  (e.g . ,  Table  4  in  the  main  body  of 
this  report),  it  was  deemed  advisable  to  use  the  unweighted  composite  scores, 
which  are  simply  a  sum  of  the  mean  z-scores  of  the  component  scales,  each  of 
which  is  based  upon  a  different  number  of  observations.  This  allows  the  maximum 
number  of  observations  to  enter  into  the  computations. 


Investigation  of  Group  Differences 

One  of  the  first  questions  addressed  in  the  data  analysis  was  whether  or  not 
there  were  significant  differences  among  any  of  the  groups  included  in  the 
population  (i,e.,  military  and  civilian,  managers  and  personnel ists,  staff  and 
field,  Roadmap  participants  and  nonparticipants).  If  such  differences  existed, 
there  would  be  implications  for  the  subsequent  analyses.  Statistical 
comparisons  of  group  responses  were  made  in  two  ways: 

1.  First,  possible  differences  in  responses  to  individual  items  were 
considered.  Although  the  raw  data  for  this  investigation  is  clearly  ordinal, 
converting  responses  to  z-scores  made  the  use  of  parametric  statistics 
mathematically  valid  (although  an  interpretation  of  results  from  parametric 
tests  would  be  questionable).  A  series  of  t-tests  was  used  as  a  screening 
device  to  determine,  with  maximum  power,  whether  any  differences  merited  closer 
inspection  using  nonparametric  tests.  Using  a  Bonferroni  adjustment  to  hold  the 
global  alpha  level  to  5  percent,  no  such  differences  emerged.  This  is  not 
surprising  when  one  considers  the  large  variability  in  responses  that  is  evident 
in  Tables  C-l  through  C-16,  which  contain  summary  statistics  for  each  of  the 
groups  on  each  of  the  scales. 


2.  Next,  differences  in  patterns  of  responses  to  the  four  different  scales 
were  analyzed  using  a  nonparametric  technique,  Friedman's  two-way  analysis  of 
variance.  Table  C- 17  reports  the  Kendall's  coefficients  of  concordance  (Kendall's 
W)  that  emerged  from  those  analyses.  Again,  no  systematic  differences  were  found. 

Figures  C-l  through  C-4  depict  graphically  the  comparisons  that  were  made 
for  each  of  the  groups  on  each  of  the  items  on  the  composite  scale.  In  looking 
at  these  figures,  one  should  focus  on  the  pairs  of  bars  that  appear  for  each 
questionnaire  item  in  a  given  figure.  Keep  in  mind  that  statistically  reliable 
differences  in  responses  would  be  indicated  if  one  of  the  two  vertical  bars  in  a 
pair  did  not  overlap  (on  the  Adjusted  Score  scale)  with  the  other  bar.  Since 
this  is  not  the  case  for  any  of  the  items  in  any  of  the  groups,  one  can  conclude 
that  there  are  no  systematic  differences  among  groups  on  responses  to  the  16 
items  on  the  composite  scale.  This  was  also  the  case  on  the  other  scales. 


Analyses  of  Combined  Groups 


Response  patterns.  Having  eliminated  group  membership  as  an  explanatory 
variable,  all  subsequent  analyses  were  performed  using  the  aggregate  data  set  of 
81  responses.  Tables  C-18  through  C-21  present  the  summary  statistics  for  the 
combined  data  on  each  of  the  four  scales.  Figure  C-5  through  C-8  graphically 
depict  the  mean  scores  for  each  item  on  each  scale.  Note  that  the  survey 
participants  tended  to  respond  positively  to  the  need-for-improvement  dimension 
(Figure  C-6)  and  negatively  to  the  1 ikel ihood-of-action  dimension  (Figure  C-8), 
with  the  consequences-of-no-improvement  dimension  (Figure  C-7)  being  in  between. 
Of  course,  positive  and  negative  responses  calculated  for  the  composite 
dimension  (Figure  C-5)  tended  to  balance  each  other. 

Scale  comparisons.  A  question  of  interest  is  whether  the  scales  represent 
separate  constructs  or  not.  If  two  scales  represented  very  similar  constructs, 
the  pattern  of  responses  on  one  scale  would  tend  to  be  like  those  on  the  other. 
This  question  was  approached  using  Friedman's  two-way  analysis  of  variance  on 
all  possible  two-scale,  three-scale,  and  four-scale  comparisons  (a  total  of  11 
tests).  Kendall's  coefficient  of  concordance  was  used  as  the  test  statistic. 
Only  three  comparisons  were  not  significantly  different  at  a  global  alpha  level 
of  5  percent:  each  of  the  original  three  scales  with  the  composite  scale 
(Kendall's  W  values  of  0.250,  0.250,  and  0.141).  This  is  not  surprising, 
considering  the  inherent  lack  of  independence  of  these  pairs.  All  other  tests 
supported  the  hypothesis  that  the  scales  are  indeed  different,  with  values  of 
Kendall's  W  ranging  from  1.00  (for  the  three  pairwise  comparisons  among  the 
original  scales)  to  0.438  (for  the  following  three-scale  comparison:  composite, 
need-for-improvement,  and  consequences-of-no-improvement). 

Grouping  of  items.  Once  the  research  areas  were  prioritized,  it  was 
desirable  to  group  them  into  fewer  than  16  distinct  entities,  so  that  gross 
generalizations  could  be  made.  Tukey's  honestly  significant  difference  (HSO) 
method,  a  post  hoc  technique  based  on  the  studentized  range  statistic,  was 
selected  for  this  purpose.  The  Tukey  HSO  approach  resulted  in  seven  subgroups 
of  items,  and  a  visual  inspection  of  the  groupings  led  to  the  three  grouos 
represented  in  Figure  C-9.  The  four  items  in  the  top  group  have  adjusted 
z-scores  that  are  reliably  higher  than  those  in  the  middle  or  bottom  groups,  and 
the  seven  items  in  the  middle  group  have  scores  that  are  reliably  higher  than 
the  five  items  in  the  bottom  group. 
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Table  C-l 

Group  Comparisons  of  Weighted  Composite  Scores:  Managers 
Versus  Personnel ists 


Weighted  composite  score 


Manager 


Personnel ist 


See  Table  1  for  specification  of  research  areas. 

Means  are  z-scores,  normalized  for  each  respondent. 

Composite  scores  are  based  only  on  those  respondents  that  entered  a  "1", 
"3",  or  "4"  for  all  three  dimensions  on  an  item. 

High  scores  reflect  high  overall  rankings;  low  scores  reflect  low  overall 
rankings. 


Table  C-2 
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Group  Comparisons  of  Need-for-Improvement  Scores:  Managers 
Versus  Personnelists 


How  valuable  would  it  be  to  the  Army  to  improve 
things  in  this  area? 


Manager 


Personnel i st 


N 

Mean 

Std.  Dev. 

N 

Mean 

Std.  Dev. 

01 

52 

.964 

.666 

21 

.957 

.502 

Q2 

52 

.545 

.750 

21 

.329 

.713 

Q3 

47 

-.120 

1.069 

19 

-.257 

1.242 

Q4 

52 

.845 

.678 

20 

.644 

.936 

Q5 

51 

.801 

.742 

20 

.692 

.785 

Q6 

52 

.066 

.901 

21 

.040 

.720 

Q7 

53 

.276 

.773 

21 

.227 

.733 

08 

52 

.645 

.799 

21 

.353 

.945 

Q9 

53 

.7:. 

.685 

21 

.677 

.615 

oio 

53 

.757 

.628 

20 

.779 

.838 

Qll 

52 

.568 

.648 

21 

.406 

.713 

Q 12 

52 

.484 

.849 

21 

.473 

.985 

Q13 

52 

.411 

.890 

21 

.458 

.935 

Q14 

52 

-.032 

.844 

21 

-.423 

1.072 

Q15 

52 

-.140 

.858 

21 

.022 

.745 

Q16 

52 

.037 

.807 

21 

-.253 

.877 

Notes. 

See  Table  1  for  specification  of  research  areas. 

Means  are  z-scores,  normalized  for  each  respondent. 

High  scores  indicate  much  value;  low  values  indicate  little  value. 
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Group  Comparisons  of  Consequences-of-No-Improvement  Scores: 
Managers  Versus  Personnelists 


How  serious  are  the  consequences  for  the  Army  of 
not  improving  things  in  this  area? 


Manager 


Personnel ist 


Std.  Dev 


Std.  Dev. 


Notes. 

See  Table  1  for  specification  of  research  areas. 

Means  are  z-scores,  normalized  for  each  respondent. 

High  scores  indicate  serious  consequences;  low  scores  indicate  lack  of  serious 
consequences. 
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Table  C-4 

Group  Comparisons  of  Like! ihood-of-Action  Scores: 
Versus  Personnel ists 


Managers 


If  additional  information  on  this  topic  were  obtained  from 
research,  how  confident  are  you  that  this  information 
would  be  used  or  acted  upon? 


Manager 


Notes. 

See  Table  1  for  specification  of  research  areas. 

Means  are  z-scores,  normalized  for  each  respondent. 

High  scores  indicate  confidence  that  information  would  be  used;  low  scores 
indicate  lack  of  confidence  that  information  would  be  used. 
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Table  C-5 
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Group  Comparisons  of  Weighted  Composite  Scores:  Field  Versus 
Staff  Assignments 


Weighted  composite  score 


rankings. 
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Table  C-6 

Group  Comparisons  of  Need-for-Improvement  Scores: 
Versus  Staff  Assignments 

Field 

How  valuable  would  it  be  to 
things  in  this 

the  Army  to  improve 
area? 

Field 

Staff 

N  Mean  Std.  Dev.  N 

Mean  Std.  Dev. 

See  Table  1  for  specification  of  research  areas. 

Means  are  z-scores,  normalized  for  each  respondent. 

High  scores  indicate  much  value;  low  values  indicate  little  value. 
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Group  Comparisons  of  Consequences-of-No-Improvement  Scores: 
Field  Versus  Staff  Assignments 


How  serious  are  the  consequences  for  the  Army  of 
not  improving  things  in  this  area? 


Field 


Staff 


N 

Mean 

Std.  Dev. 

N 

Mean 

Std.  Dev. 

01 

45 

.522 

.698 

26 

.708 

.752 

Q2 

45 

.149 

.745 

26 

.161 

.793 

Q3 

41 

-.457 

1.178 

23 

-.028 

1.050 

Q4 

44 

.571 

.748 

26 

.814 

.596 

Q5 

44 

.548 

.782 

25 

.463 

.998 

Q6 

45 

-.129 

.809 

26 

.027 

.856 

07 

44 

-.104 

.868 

27 

-.125 

.799 

Q8 

45 

.235 

.841 

26 

.478 

.747 

Q9 

45 

.376 

.700 

27 

.588 

.726 

010 

45 

.485 

.597 

26 

.353 

.599 

Oil 

45 

.235 

.745 

26 

.378 

.638 

Q12 

45 

.262 

.894 

26 

.065 

1.075 

Q13 

45 

.219 

.767 

26 

.356 

1.006 

Q14 

45 

-.220 

.784 

26 

-.274 

.888 

Q15 

45 

-.026 

.774 

26 

-.285 

.820 

016 

45 

-.242 

.911 

26 

-.268 

.681 

Notes. 


See  Table  1  for  specification  of  research  areas. 

Means  are  z-scores,  normalized  for  each  respondent. 

High  scores  indicate  serious  consequences;  low  scores  indicate  lack  of  serious 
consequences. 


Group  Comparisons  of  Likel ihood-of-Action  Scores:  Field  Versus 
Staff  Assignments 


If  additional 
research. 

information  on  this  topic  were  obtained  from 
how  confident  are  you  that  this  information 
would  be  used  or  acted  upon? 

Field 

Staff 

N 

Mean 

Std.  Dev. 

N 

Mean 

Std.  Dev. 

Q1 

41 

-.737 

.906 

26 

-.476 

1.050 

02 

39 

-.755 

.773 

26 

-.296 

.925 

Q3 

34 

-.435 

.885 

21 

-.474 

.921 

Q4 

40 

-.055 

.900 

26 

-.347 

.913 

05 

41 

-1.082 

1.197 

25 

-1.016 

.923 

06 

40 

-.689 

.830 

26 

-.640 

.949 

Q7 

41 

-.460 

.843 

26 

-.568 

.767 

Q8 

43 

-.725 

.987 

26 

-.427 

.867 

Q9 

39 

-.161 

.830 

27 

-.346 

.778 

Q10 

41 

-.356 

.881 

26 

.023 

.933 

Oil 

43 

-.686 

.704 

26 

-.654 

.709 

Q12 

41 

-.674 

1.109 

26 

-.650 

.899 

013 

43 

-.711 

.966 

26 

-.856 

1.090 

Q14 

41 

-.912 

.783 

26 

-1.203 

.754 

015 

42 

-.618 

.818 

26 

-.662 

.775 

Q16 

42 

-1.022 

.960 

26 

-.660 

.865 

Notes. 


See  Table  1  for  specification  of  research  areas. 

Means  are  z-scores,  normalized  for  each  respondent. 

High  scores  indicate  confidence  that  information  would  be  used;  low  scores 
indicate  lack  of  confidence  that  information  would  be  used. 
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Table  C-9 

Group  Comparisons  of  Weighted  Composite  Scores: 
Participants  Versus  Nonparticipants 


Roadmap 


Weighted  composite  score 

Roadmap  Participant 

Roadmap  Nonparticipant 

N 

Mean 

Std.  Dev. 

N 

Mean 

Std.  Dev. 

Q1 

24 

.642 

1.289 

44 

1.028 

1.765 

Q2 

24 

-.081 

1.965 

43 

.199 

1.396 

Q3 

20 

-1.302 

2.857 

35 

-.077 

1.904 

04 

26 

1.090 

1.710 

41 

1.657 

1.105 

Q5 

24 

.263 

1.589 

43 

.271 

1.844 

06 

25 

-.743 

1.715 

42 

-.561 

1.846 

07 

23 

-.342 

1.700 

44 

-.293 

1.540 

Q8 

26 

.551 

1.723 

44 

.116 

1.922 

09 

24 

1.286 

1.546 

43 

.908 

1.405 

010 

25 

.959 

1.241 

43 

1.070 

1.590 

Oil 

26 

-.235 

1.502 

44 

.355 

1.378 

012 

25 

.640 

1.374 

43 

-.253 

2.145 

013 

26 

.637 

1.617 

44 

-.401 

2.026 

Q14 

25 

-1.542 

1.997 

43 

-1.220 

1.943 

015 

25 

-.305 

1.927 

44 

-1.116 

1.783 

Q16 

25 

-.832 

1.951 

44 

-1.214 

1.881 

Notes. 

See  Table  1  for  specification  of  research  areas. 

Means  are  z-scores,  normalized  for  each  respondent. 

Composite  scores  are  based  only  on  those  respondents  that  entered  a  "1",  "2", 
"3",  or  "4"  for  all  three  dimensions  on  an  item. 

High  scores  reflect  high  overall  rankings;  low  scores  reflect  low  overall 
rankings. 
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Group  Comparisons  of  Need-for-Improvement  Scores:  Roadmap 
Participants  Versus  Nonpar cicipants 


'i 


Group  Comparisons  of  Consequences-of-No-Improvement  Scores: 
Roadmap  Participants  Versus  Nonparticipants 


How  serious  are  the  consequences  for  the  Army 
not  improving  things  in  this  area? 

of 

Roadmap  Participant 

Roadmap  Nonparticipant 

N 

Mean 

Std.  Dev. 

N 

Mean 

Std.  Dev. 

Ql 

27 

.452 

.638 

46 

.695 

.748 

Q2 

27 

.010 

.833 

46 

.257 

.694 

03 

25 

-.643 

1.346 

41 

-.102 

.979 

Q4 

27 

.561 

.692 

45 

.695 

.728 

Q5 

26 

.413 

.902 

45 

.581 

.823 

06 

27 

-.167 

.762 

46 

-.033 

.852 

Q7 

26 

-.168 

.986 

47 

-.074 

.733 

Q8 

27 

.445 

.791 

46 

.288 

.825 

Q9 

27 

.424 

.786 

47 

.481 

.663 

Q10 

27 

.353 

.440 

46 

.494 

.664 

Oil 

27 

.112 

.790 

46 

.380 

.626 

Q12 

27 

.340 

.809 

46 

.142 

1.041 

Q13 

27 

.483 

.569 

46 

.112 

.966 

014 

27 

-.361 

.800 

46 

-.177 

.863 

Q15 

27 

-.037 

.781 

46 

-.162 

.792 

Q16 

27 

-.263 

.901 

46 

-.230 

.799 

Notes. 


See  Table  1  for  specification  of  research  areas. 

Means  are  z-scores,  normalized  for  each  respondent. 

High  scores  indicate  serious  consequences;  low  scores  indicate  lack  of  serious 
consequences. 
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Table  C-12 

Group  Comparisons  of  Llkel Ihood-of-Action  Scores: 
Participants  Versus  Nonparticipants 


Roadmap 


If  additional  information  on  this  topic  were  obtained  from 
research,  how  confident  are  you  that  this  information 
would  be  used  or  acted  upon? 


See  Table  1  for  specification  of  research  areas. 

Means  are  z-scores,  normalized  for  each  respondent. 

High  scores  indicate  confidence  that  information  would  be  used;  low  scores 
indicate  lack  of  confidence  that  information  would  be  used. 


I 

Roadmap  Participant 

Roadmap  Nonparticipant 

i 

N 

Mean 

Std.  Dev. 

N 

Mean 

Std.  Dev. 

I 

Q1 

24 

-.643 

.987 

44 

-.645 

.957 

1 

Ej 

02 

24 

-.541 

.997 

43 

-.585 

.781 

T 

V 

03 

21 

-.644 

.978 

35 

-.356 

.826 

7 

t 

1 

Q4 

26 

-.198 

.859 

41 

-.152 

.939 

> 

* 

1 

Q5 

24 

-1.044 

.951 

43 

-1.095 

1.181 

R 

06 

25 

-.745 

.868 

42 

-.639 

.876 

1 

M 

Q7 

24 

-.468 

.908 

44 

-.537 

.759 

Q8 

26 

-.543 

1.078 

44 

-.668 

.867 

h 

n 

1 

09 

24 

.075 

.838 

43 

-.433 

.745 

S 

< 

Q10 

25 

-.327 

.942 

43 

-.164 

.906 

3 

Qll 

26 

-.692 

.605 

44 

-.675 

.756 

Q12 

25 

-.570 

.996 

43 

-.734 

1.041 

5 

013 

26 

-.620 

1.075 

44 

-.862 

.960 

3 

Q14 

25 

-1.178 

.758 

43 

-.941 

.779 

0 

I 

Q15 

25 

-.477 

.816 

44 

-.738 

.774 

$ 

. 

Q16 

25 

-.846 

.982 

44 

-.913 

.909 

i 

. 

i’S  i'-Li'i 
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Table  C-13 

Group  Comparisons  of  Weighted  Composite  Scores: 
Versus  Military  Respondents 


Civilian 


Weighted  composite  score 

Civilian 

Mi  1 itary 

N 

Mean 

Std.  Dev. 

N 

Mean 

Std.  Dev. 

Q1 

42 

.990 

1.449 

26 

.734 

1.869 

Q2 

43 

.047 

1.661 

24 

.193 

1.556 

Q3 

32 

-.539 

2.552 

23 

-.499 

2.084 

Q4 

42 

1.361 

1.511 

25 

1.565 

1.169 

05 

42 

.187 

1.435 

25 

.405 

2.196 

Q6 

43 

-.861 

1.658 

24 

-.213 

1.966 

07 

43 

-.247 

1.744 

24 

-.422 

1.276 

Q8 

44 

.396 

1.977 

26 

.077 

1.630 

09 

41 

.954 

1.281 

26 

1.186 

1.715 

010 

42 

.951 

1.345 

26 

1.156 

1.655 

on 

44 

.064 

1.512 

26 

.257 

1.340 

Q12 

43 

.505 

1.648 

25 

-.664 

2.194 

Q13 

44 

.008 

1.885 

26 

-.056 

2.066 

Q14 

43 

-1.486 

2.111 

25 

-1.085 

1.660 

015 

43 

-1.052 

2.036 

26 

-.443 

1.500 

Q16 

43 

-.793 

2.010 

26 

-1.544 

1.638 

Notes. 

See  Table  1  for  specification  of  research  areas. 

Means  are  z-scores,  normalized  for  each  respondent. 

Composite  scores  are  based  only  on  those  respondents  that  entered  a  "1",  "2", 
"3",  or  "4"  for  all  three  dimensions  on  an  item. 

High  scores  reflect  high  overall  rankings;  low  scores  reflect  low  overall 
rankings. 


Gi oup  Comparisons  of  Need-for-Improvement  Scores:  Civilian 
Versus  Military  Respondents 


How  valuable  would  it  be  to  the  Army  to  improve 
things  in  this  area? 


N 

Mean 

Std.  Dev 

N 

Mean 

Std.  Dev.  ~  jjj 

Q1 

46 

1.015 

.568 

27 

.873 

» 

.702  ^ 

Q2 

46 

.476 

.734 

27 

.494 

.766  M 

Q3 

40 

-.226 

1.128 

26 

-.056 

1.105  K 

Q4 

45 

.703 

.832 

27 

.934 

.600  a 

Q5 

45 

.713 

.604 

26 

.870 

.958  W 

Q6 

46 

.055 

.849 

27 

.064 

.862  f 

07 

46 

.290 

.785 

28 

.216 

.721 

Q8 

46 

.566 

.862 

27 

.552 

.837  :s 

Q9 

46 

.647 

.637 

28 

.826 

.699  § 

Q10 

45 

.678 

.567 

28 

.899 

.836  *5 

on 

46 

.498 

.612 

27 

.561 

.760  $ 

012 

46 

.636 

.756 

27 

.216 

1.027  | 

Q13 

46 

.472 

.835 

27 

.343 

1.005  A 

014 

46 

-.227 

.937 

27 

-.003 

.905  ^ 

Q15 

46 

-.172 

.838 

27 

.041 

.801  A 

Q16 

46 

.010 

.891 

27 

-.142 

.726  » 

$ 

Notes. 

$ 

See  Table 

1  for  specification 

of  research  areas. 

<5 

% 

Means  are 

z-scores 

,  normalized 

for  each 

respondent. 

i 

High  scores  indicate  much  value;  low  values  indicate 

little  value. 

% 

sa 

s 

C- 13 

1 

Group  Comparisons  of  Consequences-of-No-Improvement  Scores: 
Civilian  Versus  Military  Respondents 


How  serious 

are  the 

consequences  for 

■  the  Army 

Of 

not 

improving 

things  in  this 

area? 

Civilian 

Mi  1 itary 

N 

Mean  Std.  Oev. 

N 

Mean 

Std.  Dev. 

Q1 

46 

.706 

.698 

27 

.433 

.723 

02 

46 

.262 

.678 

27 

.003 

.853 

03 

40 

-.295 

1.115 

26 

-.325 

1.231 

04 

45 

.690 

.740 

27 

.570 

.673 

05 

45 

.544 

.751 

26 

.477 

1.013 

06 

46 

-.091 

.786 

27 

-.068 

.883 

07 

46 

-.019 

.799 

27 

-.260 

.866 

Q8 

46 

.505 

.818 

27 

.075 

.736 

Q9 

46 

.458 

.655 

28 

.464 

.794 

Q10 

45 

.470 

.576 

28 

.395 

.625 

Qll 

46 

.301 

.748 

27 

.246 

.616 

Q12 

46 

.373 

.912 

27 

-.052 

1.000 

Q13 

46 

.324 

.842 

27 

.122 

.879 

014 

46 

-.337 

.858 

27 

-.088 

.798 

Q15 

46 

-.210 

.840 

27 

.045 

.667 

016 

46 

-.118 

.841 

27 

-.453 

.787 

Notes. 


See  Table  1  for  specification  of  research  areas. 

Means  are  z-scores,  normalized  for  each  respondent. - 

High  scores  indicate  serious  consequences;  low  scores  indicate  lack  of  serious 
consequences. 


Group  Comparisons  of  Likel ihood-of-Action  Scores:  Civilian 
Versus  Military  Respondents 


If  additional 
research. 

information  on  this  topic  were  obtained  from 
how  confident  are  you  that  this  information 
would  be  used  or  acted  upon? 

Civilian 

Military 

N 

Mean 

Std.  Dev. 

N 

Mean 

Std.  Dev. 

Q1 

42 

-.685 

.922 

26 

-.578 

1.035 

02 

43 

-.669 

.842 

24 

-.390 

.873 

Q3 

32 

-.419 

.927 

24 

-.523 

.850 

Q4 

42 

-.213 

.896 

25 

-.097 

.929 

05 

42 

-1.145 

.937 

25 

-.961 

1.337 

Q6 

43 

-.834 

.856 

24 

-.400 

.835 

07 

43 

-.540 

.789 

25 

-.466 

.856 

08 

44 

-.714 

1.042 

26 

-.465 

.746 

09 

41 

-.299 

.790 

26 

-.177 

.853 

010 

42 

-.232 

.840 

26 

-.211 

1.043 

Oil 

44 

-.728 

.687 

26 

-.603 

.726 

Q12 

43 

-.521 

.899 

25 

-.935 

1.173 

Q13 

44 

-.897 

1.052 

26 

-.560 

.895 

014 

43 

-1.067 

.861 

25 

-.960 

.607 

Q15 

43 

-.698 

.855 

26 

-.554 

.687 

016 

43 

-.814 

.967 

26 

-1.012 

.867 

Notes. 


See  Table  1  for  specification  of  research  areas. 

Means  are  z-scores,  normalized  for  each  respondent. 

High  scores  indicate  confidence  that  information  would  be  used;  low  scores 
indicate  lack  of  confidence  that  information  would  be  used. 
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Table  C-17 


Comparison  of  Group  Response  Patterns  on  Rating  Scales: 
Coefficients  of  Concordance 


Table  of  Kendall 's 


Scale 

Group  comparison 

Need  for 
improvement 

Consequences 
of  no 

improvement 

Likelihood 
of  action 

Weighted 

composite 

Civilian  versus  military 

0.063 

0.250 

0.391 

0.063 

Staff  versus  field 

0.016 

0.016 

0.016 

0.000 

Personnel i st  versus  manager 

0.391 

0.063 

0.141 

0.000 

Roadmap  participant  versus 
nonparticipant 

0.000 

0.250 

0.063 

0.063 

Notes. 


Probabilities  of  observing  the  above  values  for  Kendall's  coefficient  of 
concordance  (Kendall's  W)  are  greater  than  5  percent  under  the  true  null 
hypothesis  that  the  responses  came  from  the  same  population  (with  Bonferroni 
adjustment  to  maintain  the  Type  I  familywise  error  rate  at  5  percent). 


Composite  scores  are  "weighted"  in  that  they  were  calculated  by  summing  the  mean 
z-scores  for  the  three  rating  scales  that  appeared  on  the  Prioritization  Survey. 
Since  only  those  observations  with  valid  data  on  all  three  scales  were  used,  the 
number  of  observations  within  each  row  is  equal  (across  columns). 
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Table  C-18 

Weighted  Composite  Scores:  Aggregate  Summary  Statistics 

Weighted  composite  score 


N 

Mean 

Std.  Dev. 

Q1 

74 

.988 

1.635 

Q2 

73 

.140 

1.597 

Q3 

59 

-.460 

2.298 

Q4 

73 

1.361 

1.422 

Q5 

73 

.179 

1.779 

Q6 

71 

-.634 

1.758 

Q7 

72 

-.363 

1.561 

Q8 

76 

.300 

1.794 

Q9 

73 

1.075 

1.436 

Q10 

74 

.994 

1.448 

Qll 

76 

.085 

1.451 

Q12 

74 

-.022 

1.930 

Q13 

76 

-.049 

1.917 

Q14 

74 

-1.251 

1.930 

Q15 

74 

-.774 

1.841 

Q16 

74 

-1.017 

1.891 

Notes. 

See  Table  1  for  specification  of  research  areas. 

Means  are  z-scores,  normalized  for  each  respondent. 

Composite  scores  are  based  only  on  those  respondents  that  entered  a  "1",  "2", 
"3",  or  "4"  for  all  three  dimensions  on  an  item. 

High  scores  reflect  high  overall  rankings;  low  scores  reflect  low  overall 
rankings. 
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Table  C-19 

Need-for-Improvement  Scores:  Aggregate  Summary  Statistics 


How  valuable  would  it  be  to  the  Army 
to  improve  things  in  this  area? 


N 

Mean 

Std.  Dev. 

01 

79 

.972 

.600 

Q2 

79 

.481 

.725 

03 

70 

-.132 

1.096 

04 

78 

.794 

.735 

Q5 

77 

.749 

.753 

Q6 

78 

.059 

.847 

07 

80 

.221 

.768 

08 

79 

.601 

.828 

09 

80 

.743 

.647 

010 

79 

.774 

.675 

Oil 

79 

.489 

.674 

Q12 

79 

.471 

.913 

013 

79 

.447 

.901 

Q14 

79 

-.099 

.920 

Q15 

78 

-.052 

.824 

016 

79 

-.037 

.827 

jtj 


Table  C-20 


LI kel i hood-of-Acti on  Scores:  Aggregate  Summary  Statistics 


If  additional  information  on  this  topic  were  obtained 
from  research,  how  confident  are  you  that  this 
information  would  be  used  or  acted  upon? 


N 

Mean 

Std.  Dev 

Ql 

74 

-.584 

.983 

Q2 

73 

-.549  • 

.855 

Q3 

60 

-.472 

.873 

Q4 

73 

-.203 

.887 

Q5 

73 

-1.098 

1.066 

Q6 

71 

-.691 

.858 

Q7 

73 

-.505 

.799 

Q8 

76 

-.634 

.923 

Q9 

73 

-.276 

.810 

Q10 

74 

-.286 

.924 

QH 

76 

-.683 

.690 

Q12 

74 

-.715 

1.021 

Q13 

76 

-.837 

1.025 

Q14 

74 

-1.006 

.765 

Q15 

74 

-.682 

.811 

Q16 

74 

-.889 

.953 

Notes. 

See  Table  1  for  specification  of  research  areas. 

Means  are  z-scores,  normalized  for  each  respondent. 

High  scores  indicate  confidence  that  information  would  be  used;  low  scores 
indicate  lack  of  confidence  that  information  would  be  used. 
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Military 
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Civilian 

Military 


Notes . 


See  Table  1  for  specification  of  research  areas. 


The  open  circle  represents  the  mean  z-score  for  the  group-increased  by  a 
constant  of  3  to  eliminate  negative  scores-and  the  filled  circles  represent  the 
upper  and  lower  bounds  of  95%  confidence  intervals  around  that  mean  after 
applicable  adjustments  have  been  made. 


Figure  C-2 .  (continued) 
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Group  comparisons  of  weighted  composite  scores: 
managers  versus  personnelists. 


M  P  M  P  M  P  M  P 

Q9  Q10  Q11  Q12 


MPMPMPMP 
Q13  Q14  Q15  Q16 


Notes. 

See  Table  1  for  specification  of  research  areas. 

The  open  circle  represents  the  mean  z-score  for  the  group-increased  by  a 
constant  of  3  to  eliminate  negative  scores-and  the  filled  circles  represent  the 
upper  and  lower  bounds  of  95%  confidence  intervals  around  that  mean  after 
applicable  adjustments  have  been  made. 


Figure  C-3 .  (continued) 


Adjusted  Score  Adjusted  Score 


Notes . 

See  Table  1  for  specification  of  research  areas. 

The  open  circle  represents  the  mean  z-score  for  the  group-increased  by  a 
constant  of  3  to  eliminate  negative  scores-and  the  filled  circles  represent  the 
upper  and  lower  bounds  of  95%  confidence  intervals  around  that  mean  after 
applicable  adjustments  have  been  made. 


Figure  C-4 .  (continued) 


ote.  See  Table  1  for  specification  of  research  areas. 

:igure  C-7.  Mean  z-scores  for  Prioritization  Survey  items:  How  serious  are  the 
consequences  for  the  Army  of  not  improving  things  in  this  area? 
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Q4 

Q1 

09 

Q10 

08 

Q5 

Q2 

011 

Q12 

Q13 

Q7 

Q6 

Q15 

Q3 

Q16 

Q14 


1.5  2  2.5  3 

Adjusted  Score 


Notes 


Composite  scores  are  "unweighted"  in  that  they  were  calculated  by  summing 
the  mean  z-scores  (each  of  which  is  based  on  a  different  number  of  responses) 
for  the  three  rating  scales  that  appeared  in  the  Prioritization  Survey. 


Adjusted  scores  are  mean  z-scores  plus  3. 


Shaded  areas  separate  the  top,  middle,  and  lowest  priority  topics  as 
identified  using  the  Tukey  HSD  procedure. 


Figure  C-9 .  Prioritization  of  research  areas:  unweighted 
composite  scores. 


APPENDIX  C-l 

TEXT  OF  FOLLOW-UP  INTERVIEW18 


My  name  is  _  and  I  am  calling  with  regard  to  the 

Prioritization  Survey  distributed  by  the  Directorate  of  Civilian  Personnel  in 
mid-June.  When  you  filled  out  the  questionnaire  you  indicated  a  willingness  to 
participate  in  a  telephone  follow-up  effort.  That  is  why  I  am  calling.  Is  it 
convenient  for  you  to  spend  a  few  minutes  talking  to  me  now  about  the  survey 
itself  and  about  the  Army's  research  needs  in  the  area  of  civilian  personnel? 

The  purpose  of  this  interview  is  to  ask  you  a  few  specific  questions  about 
the  survey  and  to  give  you  an  opportunity  to  expand  upon  your  views  of  the 
research  needs  related  to  managing  Army  civilian  personnel. 

1.  According  to  my  information,  you  were  (or  were  not)  interviewed  in 
connection  with  the  original  "Roadmap"  study.  Is  that  correct? 

("Army  Strategic  Plan  for  Civilian  Personnel  Management  Research:  A  Roadmap 
for  the  Future,"  prepared  for  DCP  by  Caliber  Associates,  October,  1986) 

Are  you  familiar  with  the  final  report  that  came  out  of  that  study? 

2.  Did  you  find  it  difficult  to  understand  any  of  the  issues  that  were 
addressed  in  the  Prioritization  Survey?  If  so,  which  one(s)? 

3.  I  see  from  your  questionnaire  that  the  three  areas  in  which  you  believe  that 

a  systematic  research  effort  might  most  benefit  the  Army  are  the  following: 
_ ,  _ ,  and  _ . 


(Read  the  items  from  the  questionnaire  corresponding  to  their  responses  to 
the  three  upper  blanks  in  Section  2  of  the  questionnaire. ) 

Could  you  expand  upon  each  of  these--perhaps  explaining  your  reasons  for 
choosing  these  areas  (and  not  choosing  others),  the  specific  types  of 
research  that  you  would  hope  to  see  undertaken  in  addressing  these  issues, 
etc.? 

(There  is  one  main  objective  for  this  question:  First,  to  determine  whether 
or  not  the  respondent  understood  the  question  as  it  was  intended— i .e . , 
whether  or  not  he/she  considers  the  same  specific  issues  to  be  a  part  of 
this  broader  issue  as  outlined  in  the  document,  "Detailed  Research  Questions 
for  Items  in  Prioritization  Survey.")^ 

4.  I  also  see  from  your  questionnaire  that  the  area  in  which  you  believe  a 
systematic  research  effort  might  1  east  benefit  the  Army  is  _ . 

(Read  the  item  from  the  questionnaire  corresponding  to  their  response  to  the 
lower  blank  in  Section  2  of  the  questionnaire. ) 

Could  you  expand  upon  this  too? 


^Instructions  to  interviewer  are  in  italics. 

19This  was  an  early  draft  of  what  is  now  Appendix  A. 


(The  objective  for  asking  this  question  is  the  same  as  that  outlined  in 
M3.) 

Would  you  like  to  share  any  further  comments  about  the  “Roadmap"  study,  the 
Prioritization  Survey,  or  the  research  needs  relating  to  the  Army's  civilian 
personnel  function? 


Thank  you  very  much  for  your  cooperation. 


